Systems and methods for lighting subjects for artificial reality scenes

ABSTRACT

A computer-implemented method for lighting subjects for artificial reality scenes may include (i) identifying (a) a physical camera configured to capture a physical subject for insertion into an artificial reality scene, (b) a physical light source that is positioned such that the physical light source lights the physical subject recorded by the physical camera, and (c) lighting conditions in the artificial reality scene, (ii) determining at least one lighting parameter to light the physical subject such that lighting conditions of the physical subject blend visually with the lighting conditions in the artificial reality scene, and (iii) configuring the physical light source to light the physical subject according to the at least one lighting parameter. Various other methods, systems, and computer-readable media are also disclosed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings illustrate a number of exemplary embodimentsand are a part of the specification. Together with the followingdescription, these drawings demonstrate and explain various principlesof the instant disclosure.

FIGS. 1A and 1B are illustrations of an exemplary subject in lightingconditions that do not blend visually with the lighting conditions of anartificial reality scene.

FIGS. 2A and 2B are illustrations of an exemplary system that createslighting conditions for a subject that do blend visually with thelighting conditions of an artificial reality scene.

FIG. 3 is a block diagram of an exemplary system for lighting subjectsfor artificial reality scenes.

FIG. 4 is a flow diagram of an exemplary method for lighting subjectsfor artificial reality scenes.

FIG. 5 is an illustration of an exemplary an exemplary system thatcreates lighting conditions for a subject that change based on thelighting conditions of multiple artificial reality scenes.

FIG. 6 is an illustration of exemplary system for lighting subjects forartificial reality scenes that includes multiple light sources.

FIG. 7 is an illustration of exemplary augmented-reality glasses thatmay be used in connection with embodiments of this disclosure.

FIG. 8 is an illustration of an exemplary virtual-reality headset thatmay be used in connection with embodiments of this disclosure.

Throughout the drawings, identical reference characters and descriptionsindicate similar, but not necessarily identical, elements. While theexemplary embodiments described herein are susceptible to variousmodifications and alternative forms, specific embodiments have beenshown by way of example in the drawings and will be described in detailherein. However, the exemplary embodiments described herein are notintended to be limited to the particular forms disclosed. Rather, theinstant disclosure covers all modifications, equivalents, andalternatives falling within the scope of the appended claims.

Features from any of the embodiments described herein may be used incombination with one another in accordance with the general principlesdescribed herein. These and other embodiments, features, and advantageswill be more fully understood upon reading the following detaileddescription in conjunction with the accompanying drawings and claims.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Digitally inserting a real person being captured by a physical camerainto a computer-generated virtual scene (e.g., an artificial realityscene) may look unrealistic or strange if the lighting on the persondoes not blend visually with the lighting in the scene. The disclosedsystems and methods may improve this situation by lighting the physicalscene (e.g., using lights that are integrated into or attached to acamera assembly) to match or more closely correspond to the lighting inthe artificial reality scene. In some embodiments, the systems describedherein may use a single light source attached to a camera assembly.Additionally or alternatively, the systems described herein may usemultiple camera assemblies at different angles, each with and acting asa light source. In some embodiments, the light sources and the camerasmay be decoupled. In some examples, the systems described herein maytrack the movement of the subject's avatar through the virtual scene andupdate the light being output by the light source(s) accordingly.

In some embodiments, the systems described herein may improve thefunctioning of a computing device by improving the ability of thecomputing device to generate realistic and/or immersive artificialreality content. In one embodiment, the systems described herein mayimprove the function of a computing device by conserving resources(e.g., processing, memory, etc.) that would be otherwise used todigitally correct lighting. In some embodiments, the systems describedherein may improve the functioning of a light source by enabling thelight source to be configured based on the lighting conditions in anartificial reality scene. In one embodiment, the systems describedherein may improve the functioning of a camera by improving the abilityof the camera to capture a subject in appropriate lighting conditions.Additionally, the systems described herein may improve the field ofartificial reality by enabling artificial reality systems to generatemore realistic and/or immersive content for consumption by a creator ofthe content and/or viewers of the content.

Systems and methods for improving lighting in artificial reality scenesmay be implemented in conjunction with various different types ofartificial reality. The term “artificial reality (AR)” generallydescribes a form of reality that has been adjusted in some manner beforepresentation to a user, which may include, for example, a virtualreality, an augmented reality, a mixed reality, a hybrid reality, orsome combination and/or derivative thereof. AR content may includecompletely computer-generated content or computer-generated contentcombined with captured (e.g., real-world) content. The AR content mayinclude video, audio, haptic feedback, or some combination thereof, anyof which may be presented in a single channel or in multiple channels(such as stereo video that produces a three-dimensional (3D) effect tothe viewer). Additionally, in some embodiments, AR may also beassociated with applications, products, accessories, services, or somecombination thereof, that are used to, for example, create content in anAR and/or are otherwise used in (e.g., to perform activities in) an AR.In some embodiments, AR content may be presented in non-AR-specificchannels, such as rectilinear display (e.g., on the screen of a personalcomputing device or mobile phone). The term “artificial reality scene”may generally refer to any scene or setting in an AR environment.

In some examples, an AR system may insert a subject (e.g., a user) intoan AR scene that has different lighting conditions than the physicalspace occupied by the subject. For example, as illustrated in FIG. 1A, acamera 104 in a physical space 100 may capture a physical subject 102for insertion into an AR scene 110. The term “physical subject” maygenerally refer to the physical body of a person in a physicalenvironment, as opposed to a three-dimensional model of the person in avirtual environment. In one embodiment, as shown in FIG. 1B, a virtualsubject 106 may be a three-dimensional avatar of physical subject 102that the systems described herein insert into AR scene 110. In someexamples, lighting conditions in AR scene 110 may not match lightingconditions in physical space 100, leading to virtual subject 106appearing jarringly out-of-place in AR scene 110. For example, physicalspace 100 may be dimly lit with yellow light while AR scene 110 may bebrightly lit with cold white light, leading to virtual subject 106appearing darker and yellower than the surrounding scene. Thisdiscrepancy may reduce immersion for the user within AR scene 110 and/orfor viewers viewing AR scene 110 (e.g., through AR devices such asheadsets and/or through non-AR devices such as laptops or mobilephones).

The term “lighting conditions” may generally refer to anycharacteristics of light within a scene, on a subject, and/or capturedby a physical or virtual camera. Lighting conditions may include thecolor, directionality, and/or intensity of light from one or morephysical or virtual light sources. For example, a scene that is brightlylit with warm white light from a single light source may have differentlighting conditions than a scene that is dimly lit from two lightsources, one red and the other blue. In some embodiments, lightingconditions may include the presence, depth, and/or direction of shadows.For example, a moderately lit scene with long blue-tinted shadows to theleft of objects may have different lighting conditions from a moderatelylit scene with short green-tinted shadows to the right of objects. Insome examples, lighting conditions may include how lighting in a scenechanges over time (e.g., in intensity, color, directionality and/or anyother relevant aspect). In some embodiments, lighting conditions mayinclude light with different characteristics in different parts of ascene, such as different foreground and background lightingcharacteristics.

In some embodiments, the systems described herein may light a subject toblend visually with lighting conditions in an AR scene, improvingimmersion and quality. The phrase “blend visually with lightingconditions” may refer to any increase in correspondence between two setsof lighting conditions, whether the outcome is identical matching or amore close but non-identical correspondence. In one example, enabling asubject to blend visually with lighting conditions may includecompositing the subject and the lightning conditions. For example, asillustrated in FIGS. 2A and 2B, a camera 204 in a physical space 200capturing a physical subject 202 for insertion into an AR scene 210 maybe equipped with a light source 208 that lights physical subject 202 toblend visually with the lighting conditions in AR scene 210. In thisexample, a virtual subject 206 may blend visually with the lightingconditions in AR scene 210 due to the light provided by light source 208lighting physical subject 202 appropriately. In one example, AR scene210 may be brightly lit with cold white light from a single source(e.g., a virtual sun) and light source 208 may light physical subject202 with cold white light, enabling virtual subject 206 to blendvisually with the rest of AR scene 210.

In some embodiments, the systems described herein may be implemented ona computing device. FIG. 3 is a block diagram of an exemplary system 300for lighting subjects for artificial reality scenes. In one embodiment,and as will be described in greater detail below, a computing device 302may be configured with a light correlation module 308 that configures alight source 304 to light a subject being captured by a camera 306 toblend visually with lighting conditions in an AR scene. In someembodiments, computing device 302 may include an AR module 312 thatinserts a three-dimensional avatar of the subject captured by camera 306into the AR scene. In other embodiments, AR module 312 may be hosted ona separate computing device.

Computing device 302 generally represents any type or form of computingdevice capable of reading computer-executable instructions. For example,computing device 302 may represent a multipurpose endpoint computingdevice, such as a laptop or desktop. In other examples, computing device302 may represent an AR device, such as a headset or controller.Additional examples of computing device 302 may include, withoutlimitation, a server, a wearable device, a gaming system, a smartdevice, a personal digital assistant (PDA), etc.

Light source 304 generally represents any type or form of physicaldevice configured to produce light to light areas and/or objects (asopposed to, e.g., a status light that indicates a device is operatingbut does not light objects). In some embodiments, light source 304 mayhave a single light-emitting element, such as a bulb or light-emittingdiode (LED). In other embodiments, light source 304 may consist ofmultiple light-emitting elements working in conjunction. In someembodiments, light source 304 may be an integral, non-removable part ofthe housing of a physical camera. For example, light source 304 mayinclude a number of LEDs placed around the lens of a camera.Additionally or alternatively, light source 304 may be designed to beremovably affixed to a camera. For example, light source 304 may includea housing for a light-emitting element that can be temporarily coupledto a camera. In some embodiments, light source 304 may be entirelyindependent of a camera. For example, light source 304 may be a lamp oran LED strip. In some embodiments, light source 304 may be configured toreceive instructions (e.g., lighting parameters) via a network (e.g., alocal area network and/or a wireless network) and/or via near-fieldcommunication. In some examples, light source 304 may be a pre-existinglight in the physical space and/or other type of lighting source that isnot specifically designed to light scenes for video capture. Forexample, light source 304 may be a smart light installed in the room.

Camera 306 generally represents any type or form of device that iscapable of capturing images and/or video of a subject. In someembodiments, camera 306 may be an integrated part of a computing device,such as a laptop webcam, an AR motion tracker, or a smartphone camera.In other embodiments, camera 306 may be a specialized camera device thatis not part of a general-purpose computing device. In some examples,camera 306 may record images and/or video of a subject for later editingand/or viewing. Additionally or alternatively, camera 306 may capturelive video of a subject for real-time streaming. In some embodiments,camera 306 may transmit video via a network and/or via near-fieldcommunication. Similarly, the term “physical camera” may generally referto any of the aforementioned embodiments and/or examples.

In some embodiments, exemplary system 300 may also include one or morememory devices, such as memory 340. Memory 340 generally represents anytype or form of volatile or non-volatile storage device or mediumcapable of storing data and/or computer-readable instructions. In oneexample, memory 340 may store, load, and/or maintain one or more modules(e.g., light correlation module 308 and/or AR module 314). Examples ofmemory 340 include, without limitation, Random Access Memory (RAM), ReadOnly Memory (ROM), flash memory, Hard Disk Drives (HDDs), Solid-StateDrives (SSDs), optical disk drives, caches, variations or combinationsof one or more of the same, and/or any other suitable storage memory.

As illustrated in FIG. 3, example system 300 may also include one ormore physical processors, such as physical processor 330. Physicalprocessor 330 generally represents any type or form ofhardware-implemented processing unit capable of interpreting and/orexecuting computer-readable instructions. In one example, physicalprocessor 330 may access and/or modify one or more modules stored inmemory 340. Additionally or alternatively, physical processor 330 mayexecute one or more modules. Examples of physical processor 330 include,without limitation, microprocessors, microcontrollers, CentralProcessing Units (CPUs), Field-Programmable Gate Arrays (FPGAs) thatimplement softcore processors, Application-Specific Integrated Circuits(ASICs), portions of one or more of the same, variations or combinationsof one or more of the same, and/or any other suitable physicalprocessor.

FIG. 4 is a flow diagram of an exemplary method 400 for lightingsubjects for AR scenes. In some examples, at step 402, the systemsdescribed herein may identify (i) a physical camera configured tocapture a physical subject for insertion into an AR scene, (ii) aphysical light source that is positioned such that the physical lightsource lights the physical subject recorded by the physical camera, and(iii) lighting conditions in the AR scene. For example, the systemsdescribed herein may identify a physical camera that is an integratedpart of an AR system. Additionally or alternatively, the systemsdescribed herein may identify a general-purpose (i.e., non-AR-specific)physical camera that a user has configured to capture images and/orvideo for insertion into AR scenes. In some examples, the systemsdescribed herein may identify a physical light source by determiningthat the physical light source is connected (e.g., via a wired orwireless connection) to a computing device. In one embodiment, thesystems described herein may identify the lighting conditions in the ARscene by receiving, intercepting, and/or analyzing information from anAR system. For example, the systems described herein may query a modulethat configures lighting for the AR scene to determine the lightingparameters of the current AR scene.

At step 404, the systems and methods described herein may determine atleast one lighting parameter to light the physical subject such thatlighting conditions of the physical subject blend visually with thelighting conditions in the artificial reality scene. The systemsdescribed herein may determine the lighting parameter or parameters in avariety of ways.

The term “lighting parameter” may generally refer to any description oflight that is interpretable by a lighting source. In some examples, alighting parameter may describe the color, intensity, polarity, and/orlocation of light. For example, a lighting parameter may include ahexadecimal, RGB, and/or CMYK encoding of a color of light. In oneexample, a lighting parameter may include instructions for thepercentage intensity at which to set an LED. In some examples, alighting parameter may instruct a lighting source about which ofmultiple light bulbs to activate. Lighting parameters may includedescriptions of light outside of the human visual spectrum, such asultraviolet and/or infrared.

In some embodiments, the systems described herein may determine thelighting parameter based on a combination of the lighting in the ARscene and the lighting in the physical space occupied by the subject.For example, if the AR scene is dimly lit with magenta light and thephysical space is dimly lit with red light, the systems described hereinmay determine that lighting parameters that specify dim blue light inorder to bridge the gap between the lighting in the AR scene and thelighting in the physical space. In another example, if the AR scene isbrightly light and the physical space is moderately lit, the systemsdescribed herein determine lighting parameters that specify a moderateintensity of light. In some examples, the systems described herein maycalibrate the lighting parameters based at least in part on the outcomeof applying the lighting parameters. For example, the systems describedherein may determine lighting parameters that specify moderate intensitycyan light and may then determine that the physical space is morebrightly lit and more cyan than the AR scene. In this example, thesystems described herein may recalibrate the lighting parameters to beless intense and/or less cyan. In some embodiments, the systemsdescribed herein may continue this feedback loop for multipleiterations. In one embodiment, the systems described herein mayrecalibrate lighting parameters in response to predetermined triggers,such as when a new lighting source is added and/or when the systemsdescribed herein detect a change in ambient lighting conditions (e.g.,more light coming in through a window as the weather outside becomessunnier).

In some examples, the systems described herein may determine separateinstances of a lighting parameter and/or multiple sets of lightingparameters that affect which of several physical lights will producelight of what intensity. For example, if the physical space includesmultiple light sources and the AR scene is lit by a single light source,the systems described herein may determine lighting parameters thatspecify that only a single physical light source produce light or that asingle physical light source produce intense light and additional lightsources produce dim light. In another example, if the AR scene is lit bymultiple light sources, the systems described herein may determinelighting parameters that specify intense light from the physical lightsources with the positions that most closely match those of the virtuallight sources relative to the subject and no light or dim light from anyother physical light sources. In some embodiments, one or more lightsources may be mounted on a movable assembly (e.g., a track, a swivel,etc.) and the systems described herein may automatically repositionlight sources to light the subject in accordance with the lighting inthe virtual scene.

At step 406, the systems and methods described herein may configure thephysical light source to light the physical subject according to the atleast one lighting parameter. For example, the systems described hereinmay transmit the lighting parameters to the light source or lightsources. In some embodiments, the systems described herein may transmitthe lighting parameters via a wired and/or wireless connection.

In one embodiment, the systems described herein may insert athree-dimensional model of the subject (e.g., an avatar) into the ARscene. Additionally or alternatively, the systems described herein mayinterface with an AR system that inserts an avatar of the subject intothe AR scene. In some embodiments, the avatar may be constructed basedat least in part on video of the subject captured by one or morephysical cameras. In some examples, the systems described herein mayadapt the avatar. For example, if the physical subject is wearing an ARheadset, the systems described herein may not display the AR headset onthe subject's avatar. In one embodiment, the systems described hereinmay replace the AR headset with a computer-generated model that occludesa similar area on the subject's face as the headset, such as a helmet,mask, and/or goggles.

In some embodiments, the systems described herein may stream video ofthe avatar in the AR scene to one or more endpoint devices operated byusers who are not the subject. In one embodiment, the systems describedherein may stream the video to server that then streams the video to theendpoint devices. In one example, the subject may be playing an AR gameabout alligator wrestling while streaming their game experience toviewers. In this example, viewers may watch the avatar of the subjectwrestle virtual alligators within the AR scene. In some examples, aviewer may watch the experience via an AR device, such as a headset,that allows the viewer to be immersed in the AR scene and to view theavatar wrestling the alligator from any angle. Additionally oralternatively, a viewer may watch the virtual alligator wrestling streamon a general-purpose computing device without specialized AR features,such as a laptop or mobile phone. Viewers using a non-AR device may belimited to a single virtual camera angle or may be able to switchbetween virtual cameras. In some embodiments, the systems describedherein may use multiple physical cameras and/or sensors (e.g.,time-of-flight, light detection and ranging, etc.) to measure depth inthe physical space and place a virtual camera in the game engine tomatch the perspective of a physical camera. Regardless of the endpointviewing device and/or viewpoint, the systems described herein mayenhance viewers' viewing experience by lighting the physical subject toblend visually with the lighting conditions in the AR scene, enablingthe avatar look natural next to the alligator rather than appearingout-of-place due to different lighting.

In some embodiments, the systems described herein may detect that thelighting conditions of the AR scene are changing to new lightingconditions, determine new lighting parameter(s), and reconfigure thephysical light source(s) with the new lighting parameter(s). Forexample, as illustrated in FIG. 5, a light correlation module 504 maymonitor the lighting conditions of an AR scene 510. In one example,light correlation module 504 may configure a physical light source 502to light a physical subject such that virtual subject 506 blendsvisually with the lighting of the rest of AR scene 510. At some point intime, virtual subject 506 may move into AR scene 512 that has differentlighting conditions from AR scene 510. For example, a player of an ARgame may explore the environment and move from a moderately-lit clearingto a dimly-lit forest. In some embodiments, light correlation module 504may detect the change in lighting conditions (e.g., by monitoring and/orreceiving information form a module that configures the lights for theAR scenes) and may determine new lighting parameters that will enablephysical light source 502 to light a physical subject such that virtualsubject 506 blend visually with the lighting conditions in AR scene 512.Later, virtual subject 506 may move to yet another scene, such as ARscene 514, that has different lighting conditions from AR scene 512. Forexample, AR scene 512 may be dimly lit with green light while AR scene514 may be brightly lit with warm white light. Light correlation module504 may update the lighting parameters again to account for the changein lighting conditions and may configure physical light source 502accordingly.

In some embodiments, the systems described herein may configure multiplephysical light sources. In some examples, each light source may becoupled to a camera. For example, as illustrated in FIG. 6, a lightsource 608 may be coupled to a camera 604 and/or a light source 618 maybe coupled to a camera 614. In one example, light source 608 and/orlight source 618 may light a physical subject 602.

In some examples, the systems described herein may detect that a cameracapturing the physical subject does not have sufficient light tooptimally capture the subject and may determine the lightingparameter(s) to provide sufficient light to the camera. The term“sufficient light” may generally refer to lighting conditions thatenable a camera to capture a subject. In some embodiments, sufficientlight may enable a camera to capture a subject with an optimal level ofvisibility. For example, under certain lighting conditions it may be toodark for a camera to capture high-definition (as opposed to, e.g.,grainy) footage of the subject. In one example, the systems describedherein may determine that camera 604 does not have sufficient light tooptimally capture physical subject 602. In one embodiment, the systemsdescribed herein may determine lighting parameters that configure lightsource 608 and/or light source 618 to produce light of greater intensityso that camera 604 can optimally capture physical subject 602. In someembodiments, providing adequate and/or optimal light for physicalsubject 602 may enable camera 604 to capture additional informationabout subject 602, such as depth and/or distance information (e.g., thedistance between camera 604 and subject 602).

As described above, the systems and methods described herein may improvean AR experience for a subject and/or viewers by configuring physicallight sources to light the physical subject to blend visually with thelighting conditions of an AR scene. This may enable the systemsdescribed herein to efficiently generate an avatar of the subject thatis appropriately lit for the scene, avoiding the computationallyintensive and potentially ineffective process of digitally retouchingthe avatar in an attempt to blend visually with the lighting conditionsof the AR scene. The systems described herein may improve user immersionin AR scenes in a variety of scenarios for users interacting with AR viavarious different types of AR system.

AR systems may be implemented in a variety of different form factors andconfigurations. Some AR systems may be designed to work without near-eyedisplays (NEDs). Other AR systems may include an NED that also providesvisibility into the real world (such as, e.g., augmented-reality system700 in FIG. 7) or that visually immerses a user in an AR (such as, e.g.,virtual-reality system 800 in FIG. 8). While some AR devices may beself-contained systems, other AR devices may communicate and/orcoordinate with external devices to provide an AR experience to a user.Examples of such external devices include handheld controllers, mobiledevices, desktop computers, devices worn by a user, devices worn by oneor more other users, and/or any other suitable external system.

Turning to FIG. 7, augmented-reality system 700 may include an eyeweardevice 702 with a frame 710 configured to hold a left display device715(A) and a right display device 715(B) in front of a user's eyes.Display devices 715(A) and 715(B) may act together or independently topresent an image or series of images to a user. While augmented-realitysystem 700 includes two displays, embodiments of this disclosure may beimplemented in augmented-reality systems with a single NED or more thantwo NEDs.

In some embodiments, augmented-reality system 700 may include one ormore sensors, such as sensor 740. Sensor 740 may generate measurementsignals in response to motion of augmented-reality system 700 and may belocated on substantially any portion of frame 710. Sensor 740 mayrepresent one or more of a variety of different sensing mechanisms, suchas a position sensor, an inertial measurement unit (IMU), a depth cameraassembly, a structured light emitter and/or detector, or any combinationthereof. In some embodiments, augmented-reality system 700 may or maynot include sensor 740 or may include more than one sensor. Inembodiments in which sensor 740 includes an IMU, the IMU may generatecalibration data based on measurement signals from sensor 740. Examplesof sensor 740 may include, without limitation, accelerometers,gyroscopes, magnetometers, other suitable types of sensors that detectmotion, sensors used for error correction of the IMU, or somecombination thereof.

In some examples, augmented-reality system 700 may also include amicrophone array with a plurality of acoustic transducers 720(A)-120(J),referred to collectively as acoustic transducers 720. Acoustictransducers 720 may represent transducers that detect air pressurevariations induced by sound waves. Each acoustic transducer 720 may beconfigured to detect sound and convert the detected sound into anelectronic format (e.g., an analog or digital format). The microphonearray in FIG. 7 may include, for example, ten acoustic transducers:720(A) and 720(B), which may be designed to be placed inside acorresponding ear of the user, acoustic transducers 720(C), 720(D),720(E), 720(F), 720(G), and 720(H), which may be positioned at variouslocations on frame 710, and/or acoustic transducers 720(I) and 720(J),which may be positioned on a corresponding neckband 705.

In some embodiments, one or more of acoustic transducers 720(A)-(J) maybe used as output transducers (e.g., speakers). For example, acoustictransducers 720(A) and/or 720(B) may be earbuds or any other suitabletype of headphone or speaker.

The configuration of acoustic transducers 720 of the microphone arraymay vary. While augmented-reality system 700 is shown in FIG. 7 ashaving ten acoustic transducers 720, the number of acoustic transducers720 may be greater or less than ten. In some embodiments, using highernumbers of acoustic transducers 720 may increase the amount of audioinformation collected and/or the sensitivity and accuracy of the audioinformation. In contrast, using a lower number of acoustic transducers720 may decrease the computing power required by an associatedcontroller 750 to process the collected audio information. In addition,the position of each acoustic transducer 720 of the microphone array mayvary. For example, the position of an acoustic transducer 720 mayinclude a defined position on the user, a defined coordinate on frame710, an orientation associated with each acoustic transducer 720, orsome combination thereof.

Acoustic transducers 720(A) and 720(B) may be positioned on differentparts of the user's ear, such as behind the pinna, behind the tragus,and/or within the auricle or fossa. Or, there may be additional acoustictransducers 720 on or surrounding the ear in addition to acoustictransducers 720 inside the ear canal. Having an acoustic transducer 720positioned next to an ear canal of a user may enable the microphonearray to collect information on how sounds arrive at the ear canal. Bypositioning at least two of acoustic transducers 720 on either side of auser's head (e.g., as binaural microphones), augmented-reality device700 may simulate binaural hearing and capture a 3D stereo sound fieldaround about a user's head. In some embodiments, acoustic transducers720(A) and 720(B) may be connected to augmented-reality system 700 via awired connection 730, and in other embodiments acoustic transducers720(A) and 720(B) may be connected to augmented-reality system 700 via awireless connection (e.g., a BLUETOOTH connection). In still otherembodiments, acoustic transducers 720(A) and 720(B) may not be used atall in conjunction with augmented-reality system 700.

Acoustic transducers 720 on frame 710 may be positioned in a variety ofdifferent ways, including along the length of the temples, across thebridge, above or below display devices 715(A) and 715(B), or somecombination thereof. Acoustic transducers 720 may also be oriented suchthat the microphone array is able to detect sounds in a wide range ofdirections surrounding the user wearing the augmented-reality system700. In some embodiments, an optimization process may be performedduring manufacturing of augmented-reality system 700 to determinerelative positioning of each acoustic transducer 720 in the microphonearray.

In some examples, augmented-reality system 700 may include or beconnected to an external device (e.g., a paired device), such asneckband 705. Neckband 705 generally represents any type or form ofpaired device. Thus, the following discussion of neckband 705 may alsoapply to various other paired devices, such as charging cases, smartwatches, smart phones, wrist bands, other wearable devices, hand-heldcontrollers, tablet computers, laptop computers, other external computedevices, etc.

As shown, neckband 705 may be coupled to eyewear device 702 via one ormore connectors. The connectors may be wired or wireless and may includeelectrical and/or non-electrical (e.g., structural) components. In somecases, eyewear device 702 and neckband 705 may operate independentlywithout any wired or wireless connection between them. While FIG. 7illustrates the components of eyewear device 702 and neckband 705 inexample locations on eyewear device 702 and neckband 705, the componentsmay be located elsewhere and/or distributed differently on eyeweardevice 702 and/or neckband 705. In some embodiments, the components ofeyewear device 702 and neckband 705 may be located on one or moreadditional peripheral devices paired with eyewear device 702, neckband705, or some combination thereof.

Pairing external devices, such as neckband 705, with augmented-realityeyewear devices may enable the eyewear devices to achieve the formfactor of a pair of glasses while still providing sufficient battery andcomputation power for expanded capabilities. Some or all of the batterypower, computational resources, and/or additional features ofaugmented-reality system 700 may be provided by a paired device orshared between a paired device and an eyewear device, thus reducing theweight, heat profile, and form factor of the eyewear device overallwhile still retaining desired functionality. For example, neckband 705may allow components that would otherwise be included on an eyeweardevice to be included in neckband 705 since users may tolerate a heavierweight load on their shoulders than they would tolerate on their heads.Neckband 705 may also have a larger surface area over which to diffuseand disperse heat to the ambient environment. Thus, neckband 705 mayallow for greater battery and computation capacity than might otherwisehave been possible on a stand-alone eyewear device. Since weight carriedin neckband 705 may be less invasive to a user than weight carried ineyewear device 702, a user may tolerate wearing a lighter eyewear deviceand carrying or wearing the paired device for greater lengths of timethan a user would tolerate wearing a heavy standalone eyewear device,thereby enabling users to more fully incorporate AR environments intotheir day-to-day activities.

Neckband 705 may be communicatively coupled with eyewear device 702and/or to other devices. These other devices may provide certainfunctions (e.g., tracking, localizing, depth mapping, processing,storage, etc.) to augmented-reality system 700. In the embodiment ofFIG. 7, neckband 705 may include two acoustic transducers (e.g., 720(I)and 720(J)) that are part of the microphone array (or potentially formtheir own microphone subarray). Neckband 705 may also include acontroller 725 and a power source 735.

Acoustic transducers 720(I) and 720(J) of neckband 705 may be configuredto detect sound and convert the detected sound into an electronic format(analog or digital). In the embodiment of FIG. 7, acoustic transducers720(I) and 720(J) may be positioned on neckband 705, thereby increasingthe distance between the neckband acoustic transducers 720(I) and 720(J)and other acoustic transducers 720 positioned on eyewear device 702. Insome cases, increasing the distance between acoustic transducers 720 ofthe microphone array may improve the accuracy of beamforming performedvia the microphone array. For example, if a sound is detected byacoustic transducers 720(C) and 720(D) and the distance between acoustictransducers 720(C) and 720(D) is greater than, e.g., the distancebetween acoustic transducers 720(D) and 720(E), the determined sourcelocation of the detected sound may be more accurate than if the soundhad been detected by acoustic transducers 720(D) and 720(E).

Controller 725 of neckband 705 may process information generated by thesensors on neckband 705 and/or augmented-reality system 700. Forexample, controller 725 may process information from the microphonearray that describes sounds detected by the microphone array. For eachdetected sound, controller 725 may perform a direction-of-arrival (DOA)estimation to estimate a direction from which the detected sound arrivedat the microphone array. As the microphone array detects sounds,controller 725 may populate an audio data set with the information. Inembodiments in which augmented-reality system 700 includes an inertialmeasurement unit, controller 725 may compute all inertial and spatialcalculations from the IMU located on eyewear device 702. A connector mayconvey information between augmented-reality system 700 and neckband 705and between augmented-reality system 700 and controller 725. Theinformation may be in the form of optical data, electrical data,wireless data, or any other transmittable data form. Moving theprocessing of information generated by augmented-reality system 700 toneckband 705 may reduce weight and heat in eyewear device 702, making itmore comfortable to the user.

Power source 735 in neckband 705 may provide power to eyewear device 702and/or to neckband 705. Power source 735 may include, withoutlimitation, lithium ion batteries, lithium-polymer batteries, primarylithium batteries, alkaline batteries, or any other form of powerstorage. In some cases, power source 735 may be a wired power source.Including power source 735 on neckband 705 instead of on eyewear device702 may help better distribute the weight and heat generated by powersource 735.

As noted, some AR systems may, instead of blending an AR with actualreality, substantially replace one or more of a user's sensoryperceptions of the real world with a virtual experience. One example ofthis type of system is a head-worn display system, such asvirtual-reality system 800 in FIG. 8, that mostly or completely covers auser's field of view. Virtual-reality system 800 may include a frontrigid body 802 and a band 804 shaped to fit around a user's head.Virtual-reality system 800 may also include output audio transducers806(A) and 806(B). Furthermore, while not shown in FIG. 8, front rigidbody 802 may include one or more electronic elements, including one ormore electronic displays, one or more inertial measurement units (IMUS),one or more tracking emitters or detectors, and/or any other suitabledevice or system for creating an AR experience.

AR systems may include a variety of types of visual feedback mechanisms.For example, display devices in augmented-reality system 700 and/orvirtual-reality system 800 may include one or more liquid crystaldisplays (LCDs), LED displays, microLED displays, organic LED (OLED)displays, digital light project (DLP) micro-displays, liquid crystal onsilicon (LCoS) micro-displays, and/or any other suitable type of displayscreen. These AR systems may include a single display screen for botheyes or may provide a display screen for each eye, which may allow foradditional flexibility for varifocal adjustments or for correcting auser's refractive error. Some of these AR systems may also includeoptical subsystems having one or more lenses (e.g., conventional concaveor convex lenses, Fresnel lenses, adjustable liquid lenses, etc.)through which a user may view a display screen. These optical subsystemsmay serve a variety of purposes, including to collimate (e.g., make anobject appear at a greater distance than its physical distance), tomagnify (e.g., make an object appear larger than its actual size),and/or to relay (to, e.g., the viewer's eyes) light. These opticalsubsystems may be used in a non-pupil-forming architecture (such as asingle lens configuration that directly collimates light but results inso-called pincushion distortion) and/or a pupil-forming architecture(such as a multi-lens configuration that produces so-called barreldistortion to nullify pincushion distortion).

In addition to or instead of using display screens, some of the ARsystems described herein may include one or more projection systems. Forexample, display devices in augmented-reality system 700 and/orvirtual-reality system 800 may include micro-LED projectors that projectlight (using, e.g., a waveguide) into display devices, such as clearcombiner lenses that allow ambient light to pass through. The displaydevices may refract the projected light toward a user's pupil and mayenable a user to simultaneously view both AR content and the real world.The display devices may accomplish this using any of a variety ofdifferent optical components, including waveguide components (e.g.,holographic, planar, diffractive, polarized, and/or reflective waveguideelements), light-manipulation surfaces and elements (such asdiffractive, reflective, and refractive elements and gratings), couplingelements, etc. AR systems may also be configured with any other suitabletype or form of image projection system, such as retinal projectors usedin virtual retina displays.

The AR systems described herein may also include various types ofcomputer vision components and subsystems. For example,augmented-reality system 700 and/or virtual-reality system 800 mayinclude one or more optical sensors, such as two-dimensional (2D) or 3Dcameras, structured light transmitters and detectors, time-of-flightdepth sensors, single-beam or sweeping laser rangefinders, 3D LiDARsensors, and/or any other suitable type or form of optical sensor. An ARsystem may process data from one or more of these sensors to identify alocation of a user, to map the real world, to provide a user withcontext about real-world surroundings, and/or to perform a variety ofother functions.

The AR systems described herein may also include one or more inputand/or output audio transducers. Output audio transducers may includevoice coil speakers, ribbon speakers, electrostatic speakers,piezoelectric speakers, bone conduction transducers, cartilageconduction transducers, tragus-vibration transducers, and/or any othersuitable type or form of audio transducer. Similarly, input audiotransducers may include condenser microphones, dynamic microphones,ribbon microphones, and/or any other type or form of input transducer.In some embodiments, a single transducer may be used for both audioinput and audio output.

In some embodiments, the AR systems described herein may also includetactile (i.e., haptic) feedback systems, which may be incorporated intoheadwear, gloves, body suits, handheld controllers, environmentaldevices (e.g., chairs, floormats, etc.), and/or any other type of deviceor system. Haptic feedback systems may provide various types ofcutaneous feedback, including vibration, force, traction, texture,and/or temperature. Haptic feedback systems may also provide varioustypes of kinesthetic feedback, such as motion and compliance. Hapticfeedback may be implemented using motors, piezoelectric actuators,fluidic systems, and/or a variety of other types of feedback mechanisms.Haptic feedback systems may be implemented independent of other ARdevices, within other AR devices, and/or in conjunction with other ARdevices.

By providing haptic sensations, audible content, and/or visual content,AR systems may create an entire virtual experience or enhance a user'sreal-world experience in a variety of contexts and environments. Forinstance, AR systems may assist or extend a user's perception, memory,or cognition within a particular environment. Some systems may enhance auser's interactions with other people in the real world or may enablemore immersive interactions with other people in a virtual world. ARsystems may also be used for educational purposes (e.g., for teaching ortraining in schools, hospitals, government organizations, militaryorganizations, business enterprises, etc.), entertainment purposes(e.g., for playing video games, listening to music, watching videocontent, etc.), and/or for accessibility purposes (e.g., as hearingaids, visual aids, etc.). The embodiments disclosed herein may enable orenhance a user's AR experience in one or more of these contexts andenvironments and/or in other contexts and environments.

EXAMPLE EMBODIMENTS

Example 1: A method for lighting subjects for AR scenes may include (i)identifying (a) a physical camera configured to capture a physicalsubject for insertion into an AR scene, (b) a physical light source thatis positioned such that the physical light source lights the physicalsubject recorded by the physical camera, and (c) lighting conditions inthe AR scene, (ii) determining at least one lighting parameter to lightthe physical subject such that lighting conditions of the physicalsubject blend visually with the lighting conditions in the AR scene, and(iii) configuring the physical light source to light the physicalsubject according to the at least one lighting parameter.

Example 2: The computer-implemented method of example 1, where thephysical light source is affixed to the physical camera.

Example 3: The computer-implemented method of examples 1-2, where thephysical light source is a non-removable part of a housing that includesthe physical camera.

Example 4: The computer-implemented method of examples 1-3, where thephysical light source is a removable attachment configured to be affixedto a housing that includes the physical camera.

Example 5: The computer-implemented method of examples 1-4, whereconfiguring the physical light source to light the physical subjectincludes configuring multiple physical light sources that each light thephysical subject according to the at least one lighting parameter.

Example 6: The computer-implemented method of examples 1-5, wheredetermining the at least one lighting parameter includes determining aseparate instance of the at least one lighting parameter for each of themultiple physical light sources.

Example 7: The computer-implemented method of examples 1-6 may furtherinclude detecting that the lighting conditions of the AR scene arechanging to new lighting conditions, determining at least one newlighting parameter to light the physical subject such that the lightingconditions of the physical subject match the new lighting conditions,and configuring the physical light source to light the physical subjectaccording to the at least one new lighting parameter.

Example 8: The computer-implemented method of examples 1-7, wheredetermining the at least one lighting parameter is based at least inpart on detecting that a camera capturing the physical subject does nothave sufficient light to optimally capture the subject and determiningthe at least one lighting parameter to provide sufficient light to thecamera.

Example 9: The computer-implemented method of examples 1-8 may furtherinclude inserting a three-dimensional model of the physical subject intothe AR scene in real time.

Example 10: The computer-implemented method of examples 1-9 may furtherinclude streaming a video of a three-dimensional model of the physicalsubject in the AR scene to at least one endpoint device operated by auser who is not the physical subject.

Example 11: The computer-implemented method of examples 1-10, where theAR scene includes a setting for an AR game.

Example 12: The computer-implemented method of examples 1-11, where theat least one lighting parameter includes at least one of an intensity oflight or a color of light.

Example 13: A system for lighting subjects for AR scenes may include (i)a physical camera configured to capture a physical subject for insertioninto an AR scene, (ii) a physical light source that is positioned suchthat the physical light source lights the physical subject recorded bythe physical camera, and (iii) a light correlation module thatconfigures the physical light source to light the physical subject suchthat lighting conditions of the physical subject match lightingconditions in the AR scene by (a) identifying the lighting conditions inthe AR scene, (b) determining at least one lighting parameter to lightthe physical subject such that the lighting conditions of the physicalsubject blend visually with the lighting conditions in the AR scene, and(c) configuring the physical light source to light the physical subjectaccording to the at least one lighting parameter.

Example 14: The system of example 13, where the physical light source isaffixed to the physical camera.

Example 15: The system of examples 13-14, where the physical lightsource is a non-removable part of a housing that includes the physicalcamera.

Example 16: The system of examples 13-15, where the physical lightsource is a removable attachment configured to be affixed to a housingthat includes the physical camera.

Example 17: The system of examples 13-16, where the light correlationmodule (i) detects that the lighting conditions of the AR scene arechanging to new lighting conditions, (ii) determines at least one newlighting parameter to light the physical subject such that the lightingconditions of the physical subject match the new lighting conditions,and (iii) configures the physical light source to light the physicalsubject according to the at least one new lighting parameter.

Example 18: The system of examples 13-17, where the light correlationmodule determines the at least one lighting parameter based at least inpart on detecting that a camera capturing the physical subject does nothave sufficient light to optimally capture the subject and determiningthe at least one lighting parameter to provide sufficient light to thecamera.

Example 19: The system of examples 13-18 may further include an ARmodule that inserts a three-dimensional model of the physical subjectinto the AR scene in real time.

Example 20: A system for lighting subjects for AR scenes may include atleast one physical processor and physical memory includingcomputer-executable instructions that, when executed by the physicalprocessor, cause the physical processor to (i) identify (a) a physicalcamera configured to capture a physical subject for insertion into an ARscene, (b) a physical light source that is positioned such that thephysical light source lights the physical subject recorded by thephysical camera, and (c) lighting conditions in the AR scene, (ii)determine at least one lighting parameter to light the physical subjectsuch that lighting conditions of the physical subject blend visuallywith the lighting conditions in the AR scene, and (iii) configure thephysical light source to light the physical subject according to the atleast one lighting parameter.

As detailed above, the computing devices and systems described and/orillustrated herein broadly represent any type or form of computingdevice or system capable of executing computer-readable instructions,such as those contained within the modules described herein. In theirmost basic configuration, these computing device(s) may each include atleast one memory device and at least one physical processor.

In some examples, the term “memory device” generally refers to any typeor form of volatile or non-volatile storage device or medium capable ofstoring data and/or computer-readable instructions. In one example, amemory device may store, load, and/or maintain one or more of themodules described herein. Examples of memory devices include, withoutlimitation, Random Access Memory (RAM), Read Only Memory (ROM), flashmemory, Hard Disk Drives (HDDs), Solid-State Drives (SSDs), optical diskdrives, caches, variations or combinations of one or more of the same,or any other suitable storage memory.

In some examples, the term “physical processor” generally refers to anytype or form of hardware-implemented processing unit capable ofinterpreting and/or executing computer-readable instructions. In oneexample, a physical processor may access and/or modify one or moremodules stored in the above-described memory device. Examples ofphysical processors include, without limitation, microprocessors,microcontrollers, Central Processing Units (CPUs), Field-ProgrammableGate Arrays (FPGAs) that implement softcore processors,Application-Specific Integrated Circuits (ASICs), portions of one ormore of the same, variations or combinations of one or more of the same,or any other suitable physical processor.

Although illustrated as separate elements, the modules described and/orillustrated herein may represent portions of a single module orapplication. In addition, in certain embodiments one or more of thesemodules may represent one or more software applications or programsthat, when executed by a computing device, may cause the computingdevice to perform one or more tasks. For example, one or more of themodules described and/or illustrated herein may represent modules storedand configured to run on one or more of the computing devices or systemsdescribed and/or illustrated herein. One or more of these modules mayalso represent all or portions of one or more special-purpose computersconfigured to perform one or more tasks.

In addition, one or more of the modules described herein may transformdata, physical devices, and/or representations of physical devices fromone form to another. For example, one or more of the modules recitedherein may receive image data to be transformed, transform the imagedata into a data structure that stores user characteristic data, outputa result of the transformation to select a customized interactive icebreaker widget relevant to the user, use the result of thetransformation to present the widget to the user, and store the resultof the transformation to create a record of the presented widget.Additionally or alternatively, one or more of the modules recited hereinmay transform a processor, volatile memory, non-volatile memory, and/orany other portion of a physical computing device from one form toanother by executing on the computing device, storing data on thecomputing device, and/or otherwise interacting with the computingdevice.

In some embodiments, the term “computer-readable medium” generallyrefers to any form of device, carrier, or medium capable of storing orcarrying computer-readable instructions. Examples of computer-readablemedia include, without limitation, transmission-type media, such ascarrier waves, and non-transitory-type media, such as magnetic-storagemedia (e.g., hard disk drives, tape drives, and floppy disks),optical-storage media (e.g., Compact Disks (CDs), Digital Video Disks(DVDs), and BLU-RAY disks), electronic-storage media (e.g., solid-statedrives and flash media), and other distribution systems.

The process parameters and sequence of the steps described and/orillustrated herein are given by way of example only and can be varied asdesired. For example, while the steps illustrated and/or describedherein may be shown or discussed in a particular order, these steps donot necessarily need to be performed in the order illustrated ordiscussed. The various exemplary methods described and/or illustratedherein may also omit one or more of the steps described or illustratedherein or include additional steps in addition to those disclosed.

The preceding description has been provided to enable others skilled inthe art to best utilize various aspects of the exemplary embodimentsdisclosed herein. This exemplary description is not intended to beexhaustive or to be limited to any precise form disclosed. Manymodifications and variations are possible without departing from thespirit and scope of the instant disclosure. The embodiments disclosedherein should be considered in all respects illustrative and notrestrictive. Reference should be made to the appended claims and theirequivalents in determining the scope of the instant disclosure.

Unless otherwise noted, the terms “connected to” and “coupled to” (andtheir derivatives), as used in the specification and claims, are to beconstrued as permitting both direct and indirect (i.e., via otherelements or components) connection. In addition, the terms “a” or “an,”as used in the specification and claims, are to be construed as meaning“at least one of.” Finally, for ease of use, the terms “including” and“having” (and their derivatives), as used in the specification andclaims, are interchangeable with and have the same meaning as the word“comprising.”

What is claimed is:
 1. A computer-implemented method comprising:identifying: a physical camera configured to capture a physical subjectfor insertion into an artificial reality scene; a physical light sourcethat is positioned to light the physical subject being recorded by thephysical camera; and lighting conditions in the artificial realityscene; configuring the physical light source to light the physicalsubject such that lighting conditions of the physical subject blendvisually with the lighting conditions in the artificial reality scene;detecting that the lighting conditions of the artificial reality sceneare changing to new lighting conditions; and reconfiguring the physicallight source to light the physical subject such that the lightingconditions of the physical subject blend visually with the new lightingconditions in the artificial reality scene.
 2. The computer-implementedmethod of claim 1, wherein the physical light source is affixed to thephysical camera.
 3. The computer-implemented method of claim 2, whereinthe physical light source comprises a non-removable part of a housingthat comprises the physical camera.
 4. The computer-implemented methodof claim 2, wherein the physical light source comprises a removableattachment configured to be affixed to a housing that comprises thephysical camera.
 5. The computer-implemented method of claim 1, furthercomprising determining at least one lighting parameter to light thephysical subject such that lighting conditions of the physical subjectblend visually with the lighting conditions in the artificial realityscene, wherein configuring the physical light source comprisesconfiguring the physical light source according to the at least onelighting parameter.
 6. The computer-implemented method of claim 5,further comprising transmitting the at least one lighting parameter tothe physical light source.
 7. The computer-implemented method of claim5, wherein determining the at least one lighting parameter is based atleast in part on: detecting that a camera capturing the physical subjectdoes not have sufficient light to optimally capture the physicalsubject; and determining the at least one lighting parameter to providesufficient light to the camera.
 8. The computer-implemented method ofclaim 5, wherein the at least one lighting parameter comprise at leastone of: an intensity of light; or a color of light.
 9. Thecomputer-implemented method of claim 1, further comprising inserting athree-dimensional model of the physical subject into the artificialreality scene in real time.
 10. The computer-implemented method of claim1, further comprising streaming a video of a three-dimensional model ofthe physical subject in the artificial reality scene to at least oneendpoint device operated by a user who is not the physical subject. 11.The computer-implemented method of claim 1, wherein the artificialreality scene comprises a setting for an artificial reality game. 12.The computer-implemented method of claim 1, wherein configuring thephysical light source to light the physical subject comprisesconfiguring multiple physical light sources that each light the physicalsubject such that lighting conditions of the physical subject blendvisually with the lighting conditions in the artificial reality scene.13. The computer-implemented method of claim 12, further comprisingdetermining, for each of the multiple physical light sources, a separateinstance of at least one lighting parameter to light the physicalsubject such that lighting conditions of the physical subject blendvisually with the lighting conditions in the artificial reality scene;and wherein configuring the multiple physical light sources comprisesconfiguring the multiple physical light sources according to the atleast one lighting parameter.
 14. A system comprising: a physical cameraconfigured to capture a physical subject for insertion into anartificial reality scene; a physical light source that is positioned tolight the physical subject being recorded by the physical camera; and alight correlation module that configures the physical light source tolight the physical subject such that lighting conditions of the physicalsubject match lighting conditions in the artificial reality scene by:identifying the lighting conditions in the artificial reality scene;configuring the physical light source to light the physical subject suchthat lighting conditions of the physical subject blend visually with thelighting conditions in the artificial reality scene; detecting that thelighting conditions of the artificial reality scene are changing to newlighting conditions; and reconfiguring the physical light source tolight the physical subject such that the lighting conditions of thephysical subject blend visually with the new lighting conditions in theartificial reality scene.
 15. The system of claim 14, wherein thephysical light source is affixed to the physical camera.
 16. The systemof claim 15, wherein the physical light source comprises a non-removablepart of a housing that comprises the physical camera.
 17. The system ofclaim 15, wherein the physical light source comprises a removableattachment configured to be affixed to a housing that comprises thephysical camera.
 18. The system of claim 14, wherein the lightcorrelation module determines at least one lighting parameter to lightthe physical subject such that lighting conditions of the physicalsubject blend visually with the lighting conditions in the artificialreality scene and configures the physical light source according to theat least one lighting parameter.
 19. The system of claim 14, furthercomprising an artificial reality module that inserts a three-dimensionalmodel of the physical subject into the artificial reality scene in realtime.
 20. A system comprising: at least one physical processor; physicalmemory comprising computer-executable instructions that, when executedby the physical processor, cause the physical processor to: identify: aphysical camera configured to capture a physical subject for insertioninto an artificial reality scene; a physical light source that ispositioned to light the physical subject being recorded by the physicalcamera; and lighting conditions in the artificial reality scene;configure the physical light source to light the physical subject suchthat lighting conditions of the physical subject blend visually with thelighting conditions in the artificial reality scene; detect that thelighting conditions of the artificial reality scene are changing to newlighting conditions; and reconfigure the physical light source to lightthe physical subject such that the lighting conditions of the physicalsubject blend visually with the new lighting conditions in theartificial reality scene.